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Abstract. We investigate the rudiments of Riemannian geometry on orbit spaces 
M /G for isometric proper actions of Lie groups on Riemannian manifolds. Minimal 
geodesic arcs are length minimising curves in the metric space M/G and they can hit 
strata which are more singular only at the end points. This is phrased as convexity 
result. The geodesic spray, viewed as a (strata-preserving) vector field on TM/G, 
leads to the notion of geodesies in M/G which are projections under M —>■ M/G of 
geodesies which are normal to the orbits. It also leads to 'ballistic curves' which are 
projections of the other geodesies. In examples (Hermitian and symmetric matrices, 
and more generally polar representations) we compute their equations by singular 
symplectic reductions and obtain generalizations of Calogero-Moser systems with 
spin. 
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1. Introduction 

Differential geometry deals ordinarily with smooth objects on smooth manifolds. 
However, in many cases this assumption is too restrictive. In various contexts 
different types of non-smooth manifolds or 'manifolds with singularities' appear 
naturally, like complex algebraic varieties, orbifolds, IZ-manifolds [24], [7], limits of 
Riemannian manifolds with respect to the Gromov-Hausdorff metric [9], etc. In 
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the present paper we consider a rather special but interesting and important class 
of non-smooth manifolds, namely the orbit spaces M/G of Riemannian manifolds 
M with respect to groups G of isometries. Our goal is to develop the Riemannian 
geometry of orbit spaces. An orbit space has the structure of a stratified manifold 
with smooth strata, namely the connected components of the sets {M/G)(^h) of 
orbits of some given orbit type (or isotropy type) {H). 

Let us describe the structure of the paper. The basic facts about the orbit 
stratification of an orbit space M/G is presented in section 2. 

An orbit space of a complete Riemannian G-manifold M has a natural struc- 
ture of a metric space. Some elementary properties of this metric structure are 
collected in section 3. In particular, we establish some convexity properties of the 
stratification with respect to distance minimizing curves which we call minimal ge- 
odesic arcs. For example, the set {M/G)reg of regular orbits is a convex open dense 
submanifold of M/G. 

Some basic global differential geometric objects on M/G are defined in section 
4. We define the algebra of smooth functions C°^{M/G) on M/G as the algbera 
C°°{M)'^ of G-invariant smooth functions on M, and the Lie algebra of vector 
fields X{M/G) as the Lie algebra of aU derivations of C°°{M/G) = G^{M)^ which 
preserve all ideals of functions vanishing on some stratum. The deep result [26] of 
G. Schwarz states that the natural homomorphism X{M)'^ — > Der(C°°(M/G)) has 
X{M/G) as image. Each element of X{M/G) induces a derivation on the algebra 
of smooth functions on each stratum and thus defines an ordinary vector fields 
along each stratum. In order to define geodesies which connect different strata we 
consider the geodesic spray as a vector field on TM/ G, the projection of the geodesic 
spray r e X{TM)^. The integral curves of the geodesic spray F on TM/G stay 
within the strata, but their projection to M/G connects different strata in M/G. 
We define geodesies in M/G as projections to M/G of integral curves of F on 
TM/G which are orthogonal to orbits, i.e., in TM their initial vector should be in 
in Nor(M)a; = T^iG.x)-^ for x G M. More generally, the projection on M/G of 
an arbitrary integral curve of the geodesic spary F on TM/G is called a 'ballistic 
curve'. Imitating the classical Riemannian case, we establish some properties of the 
geodesic spray on TM/G and define Jacobi fields along gedesics and along ballistic 
curves. 

Section 5 is devoted to a more systematic study of ballistic curves in M/ G for the 
simple model case when the unitary group G — SU (n) acts on the space M — H{n) 
of Hermitian matrices by conjugation. Using the singular Hamiltonian reduction by 
Sjamaar and Lerman [27], we derive the Hamiltonian equation for a ballistic curve 
in H{n)/ SU{n). It turns out that it is a Calogero-Moser system with spin. In the 
special case when the momentum Y G 5u(n)* has maximal isotropy group, i.e. when 
Y — \/— l(c.l„ + 11}® w*) where w is a vector with — —c > the equation is 
the classical Calogero Moser system, which reproduces results of Kazhdan, Kostant, 
and Sternberg, [10]. 

The last section 6 is devoted to the generalization of the results on ballistic 
curves to the orbit space V/G where V is an Euclidean space and G C SO{V) is a 
connected subgroup of the orthogonal group whose action on V is polar, i.e. admits 
a section. 

We thank Nikolai Reshetikhin for helpful discussions and pointing out references 
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[10], [3], and [11]. 

2. Stratification of orbit spaces 

2.1. The setup. Let M be a connected G- manifold, where G is a Lie group. The 
G-action is called proper if G x M ^ M x M, given by {g, x) ^ {g-x, x), is a proper 
mapping. It is well known that proper G-actions admit slices ([20], [21], [16]): For 
each X & M there exists a submanifold Sx <Z M containing x, an open G- invariant 
neighborhood W of G.x, and a smooth equivariant retraction r : W ^ G.x such 
that = r~^{x). Moreover, for the isotropy group Gx of x we have Gx-Sx C Sx, 
and g E G with g.Sx^Sx ^ must lie in Gx- Moreover, the slice Sx is a manifold and 
Gs ^ Gx for each s E S. Finally, the action G x Sx ^ W induces an G-equivariant 
diffeomorphism G xq, Sx ^ W. This implies that C°°{W)^ = C°^{Sx)^^ via 
restriction. 

We consider the orbit space M/G and the canonical projection tt : M — > M/G, 
and we endow the quotient space M/G with the following smooth structure: The 
quotient topology and the sheaf of smooth real valued functions U h- > C°^{U) := 
G°°(7r-^(C/))'^. A mapping ip : M/G M' /G' is called smooth if it respects 
these sheafs. For a slice Sx as above on the orbit spaces we have C°°{W/G) = 
C°°{Sx/Gx)- Therefore the local smooth structure of M/G coincides with the 
smooth structure of Sx/Gx- A mapping (p : M/G M' /G' is smooth if and only 
if (p*C°°{M'/G') C G°°(M/G). 

2.2. Let if be a closed subgroup of G and let (H) denote the conjugacy class of 
H. For two closed subgroups Hi and H2 we write (i^i) < {H2) if Hi is conjugated 
to a subgroup of H2. 

Let M(j^) denote the set of points of M whose isotropy groups belong to (H). 
It is known that M(^h) is a smooth submanifold of M for proper actions (see [16], 
7.4). Put {M/G)^H) ■= ^{M^H)) = {Mi^H))/G, caU this the isotropy stratum of 
type {H), and call any connected component of this an orbit stratum of M/G. 

Proposition. [26], [16], [21]. 

(1) The isotropy stratum {M/G)(^h) = ^{h)/G is a smooth manifold, the inclu- 
sion {M/G)(^H) ~^ M/G is smooth, and n : M(jif) — > [M/G)(^h) is a smooth 
fiber bundle with fiber type G/H . 

(2) We have a smooth fiber bundle M^^) ~^ G/Ng{H) where Ng{H) is the 
normalizer of H in G, and where the fiber over g.No^H) is the fixed point 
setMa^a-' nM^u)- See [16], 7.3. 

(3) The orbit strata of M/G form a locally finite partition of M/G. 

2.3. Theorem. [16], 6.15ff. 

There exists a unique minimal isotropy type (K) such that 

(1) {M/G)(K) is connected, locally connected, open, and dense in M/G. 

(2) The slice representations at all points of M(^x) are trivial, i.e. Gx acts triv- 
ially on Sx for all x e M(x) ■ 

(3) dim(M/G) (k) = dim M - dim G + dim K. 

The stratum {M/G)(^x) is called the principal isotropy stratum and is denoted 
by (M/G)reg- Likewise we write Mreg := Mf^^y 
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2.4. Let G be a compact group and let p : G — > GL{V) be an orthogonal rep- 
resentation of G on a real finite dimensional Euclidean vector space V. Let a = 
(ai, . . . , cxn) : V — > R"^, where cri, . . . , cr„ is a system of generators for the algebra 

of invariant polynomials on V. The mapping a is proper and induces a 
homeomorphism between V/G and the closed subset cr{V) C M", see [25]. Since a 
is a polynomial map, cr^V) is a semialgebraic subset, see [23] for an explicit descrip- 
tion by polynomial equations and inequalities. By [28] and [13] the semialgebraic 
set (t{V) has a canonical stratification into smooth algebraic submanifolds, called 
the Whitney stratification. The strata for this stratification are the connected com- 
ponents of the images under a of the set of points in V where the rank of the system 
of polynomials ui, . . . , Un is constant. 

Theorem. 

(1) [5] The mapping a : V (^{V) induces a bijection a : V/G cr("l/) which 
maps the components of the isotropy strata of V j G diffeomorphically onto 
the strata of a{V) as a semialgebraic set. 

(2) [25] a* : C°°{M.'^) C°°{V)'^ is a surjective homomorphism of algebras. 
There exists a continuous linear map if : C°°{V)'^ C°°{W^) with a* o(f = 
Idc°°(R"); [15]. 

2.5. Remark. Let M be a smooth proper G-manifold. Then the orbit strati- 
fication of M/G is locally given as the Whitney stratification of a semialgebraic 
subset in a vector space; by [14] this is in turn determined by the algebra of 
smooth functions on it. Thus the orbit stratification of M/G is determined by 
C°°{M)^ = C°°{M/G). 

3. The orbit space M/G as a metric space 

Let {M,g) be a connected complete Riemannian manifold and let G be a Lie 

group of isometrics which acts properly on M (or equivalently, is closed in the 
full group of isometrics) . Then we say that (M, g) is a complete Riemannian G- 
manifold. Denote by tt : M — > M = M/G the natural projection of M onto the 
orbit space M/G. 

Denote by d the natural metric structure on M/G induced by the Riemannian 
metric g of M. By definition the distance d{p, q) is the minimum of the lengths of 
all curves in M which connect the orbits p, q. 

Recall that a metric space {X, d) is called to be of inner type [2] or a path metric 
space [9] if the distance between any two points p, q is equal to the length of a curve 
pq connecting these points. Such a curve is called a minimal geodesic segment. 

3.1. Proposition. Let {M,g) be a complete Riemannian G-manifold. Then the 
following holds: 

(1) The orbit space (M/G, d) with the natural metric is a complete metric space 
and a path metric space. 

(2) Any minimal geodesic segment of M/G is the projection of a normal (i.e. 
orthogonal to orbits) geodesic segment of M . 

(3) For every p e M/G there exists r > such that each q with d{p, q) < r can 
be connected to p by a unique minimal geodesic segment. 
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Note that even if M is compact, in (3) one cannot choose the same r > for all 
points p E M/G in general, see example 3.3. 

Proof. (1) and (2). For p,q e M there is a point g.q e G.q such that d{p,g.q) is 
the distance from p to the (closed) orbit G.q. Since M is a complete Riemannian 
manifold, there is a geodesic c of minimal length from p to g.q. This geodesic is 
orthogonal to the orbit G.p: otherwise, by Gauss' lemma, we could find a shorter 
broken geodesic fromp to g.q. By a well known lemma ([16], 8.1), c'{t) is orthogonal 
to each orbit which it meets. But then the length of tto c in M/G equals the length 
of c in M, which is the distance between the orbits G.p and G.q and thus equals 
d{p, q). 

The metric space {M/G, d) is complete since each bounded closed set is compact: 
Use that the image of a closed geodesic ball Bj.{x) C M of radius r with center 
a; e M is the closed ball Br{7r{x)) of the same radius in M/G. 

(3) Let p, q are two points of M/ G with sufficiently short distance d = d{p, q) 
and let 7, 5 be two geodesic segments in M of length d connecting the orbits p, q. 
Transforming one of the geodesies by an appropriate isometry, we may assume that 
the geodesies start from the same point p E p. Since the geodesies are normal to 
the orbit p , they belong to the slice S = exp^ N, where N is a neighbourhood of 
the origin in the normal space of the orbit p at p. The end points ■y{d), d{d) of these 
geodesies belong to the orbit q. Hence, by the main property of a slice, there exist 
an isometry h in the stabilizer Gp such that h'j{d) — d{d). Since the geodesies are 
small, this implies h'j = 6 and 71(7) = 7r(5). □ 

A normal geodesic 7 in M is called a horizontal lift of the minimal geodesic 
segment 7r(7) of M/G. The proof of (3) implies that any two horizontal lifts of a 
minimal geodesic segment of M/ G differ by the action of an isometry in G. 

We define the angle between two minimal geodesic ray segments in M/G from 
a point p as the minimum of the angles between all their horizontal lifts through 
p E p. The angle is independent of the choice of p. 

3.2. Proposition. Let G be a compact connected Lie group and p : G ^ SO{V) 
a polar orthogonal representation into a Euclidean vector space {V, g =< , >). 
Then any two points of the orbit space V/G are connected by a unique minimal 
geodesic segment. 

Proof. By definition of a polar representation there exists a linear section S, i.e., 
a vector subspace of V which intersects all orbits orthogonally, see [8]. Denote 
by W the Weyl group of a section S, that is the quotient W = Ng{S) / Zg{S), 
where Nq{S) is the subgroup of G which preserves 5" and Zg{S) is its normal 
subgroup which acts trivially on S. It is known that is a finite group generated 
by refiections in hyperplanes of S and that the orbit spaces V/G and S/W are 
isometric, [8]. This reduces the statement to the case when G is a finite group 
generated by reflections, i.e., the Weyl group of a root system. The orbit space of 
such group is the closure of a Weyl chamber which is a convex polyhedral cone of 
Euclidean space with the induced metric. Now the statement is obvious. □ 

Note that up to now we know only minimal geodesic segments; geodesies as we 
will treat them in 4.4 below will turn out to be reflected at faces, so there will be 
many different geodesies connecting two points. 
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3.3. Example. Statement 3.2 is not true if the representation p is not polar. 
Moreover, there may exist points x,y with arbitrary small distance e which are 
connected by several minimal geodesic segments. 

Let G C SO{y) be a compact connected linear group such that V is the direct 
sum of two G-invariant subspaces Vi, V2 of dimension > 1. Choose x & Vi,y E V2 
such that the stabilizer H = Gx does not act transitively on the orbit G.y. For 
example, we may assume that H = Gx = {Id}. Note that here y e Tx{G.x)-^^ but 
y is not contained in a slice at x. The maximal radius of a slice at x is just 

Then for any z G G.y the geodesic 7(t) = (1 — t)x + tz is normal, since 7'(t) = 
—x-\-zifi normal to X.^{t) = (1 — t)X.x + tX.z for each X e Q C 5o{V). It 
is a minimal geodesic which connects the orbits G.x and G.y. Hence it defines a 
minimal geodesic segment 7 in the orbit space V/G. If 2;, 2;' e Gy do not belong 
to one H orbit, then the corresponding geodesies are not G-equivalent and define 
different minimal geodesic segments of the orbit space connecting 7r(a;) and 7r(y). 

3.4. Recall that a subset of a path metric space (M, d) of is called weakly convex 
if the induced metric on is also of path metric type. So any two points in N are 
connected in M by some minimal geodesic segment which lies in N . 

A subset N of a, path metric space (M, d) is called convex if any minimal geodesic 
segment in M between two points in N lies in N. 

Denote by {M/G)<(^h) the set of orbits with orbit type smaller then {H). In 
particular, {M / G) = (-^/G^)reg if (K) denotes the minimal orbit type. 

Proposition. M<(;/) is a convex subset of M/G. In particular, (M/G)reg is a 
convex open dense submanifold. 

The proof follows from the following lemma. 

3.5. Lemma. Let pq be a minimal geodesic in M/G of length d and let pq be a 
horizontal lift. Then the stabilizer Gx of any interior point of pq is contained in 
the stabilizers Gp, Gq of the end points. 

In particular, if Gp H Gq = {K}, the minimal stabilizer group, then all interior 
points of pq are regular. 

Proof. Assume for contradiction that there exist an isometry h G Gx\Gp. Appying 
/i to a minimal geodesic px we obtain a minimal geodesic {hp)x of the same length 
which connects Gp = p and x. Then the broken geodesic {hp)xq has length d and 
connects p and q. This is impossible. 

4. Vector fields, geodesics, and Jacobi fields on orbit spaces 

4.1. Smooth vector fields on orbit spaces. Let M be a proper G-manifold 
and let Der(C°°(M/G)) denote the space of all derivations of the real algebra 
C°°{M/G); these are called smooth vector fields on M/G. A vector field X G 
Der(C°°(M/G)) is called strata-preserving if it preserves each ideal in C°°{M/G) 
consisting of functions which vanish on an orbit stratum. We denote by X{M/G) 
the Lie subalgebra of all strata-preserving vector fields. 

Theorem. [26] The canonical mapping 

X^X, X{M)^ Der (C~ (M/G)) 
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has image X{M/G). 

In [26] this is stated for compact G, but the proof works without change also for 
proper G-actions. 

Thus we have the foUowing exact sequence: 

^ X(M)^g, ^ X(M)^ ^ X{M/G) 

where j£(M)^j. is the space of aU G-invariant vector fields on M which are tangent 
to the orbits (vertical). 

Thus a strata preserving smooth vector field X G X{M/G) induces a derivation 
on the algebra of smooth functions on each stratum and thus a smooth vector field 
on each stratum which is tangent to this stratum. Moreover X induces a local fiow 
on each stratum. By using also a lift in 3£(M)'^, we get a strata preserving smooth 
mapping 

R X M/G D U M/G 

which is defined on an open neighborhood U oi x M/G in M x M/G. Clearly for 

X e X(M)^ the flows X and X e X(M/G) are related, ttm/g ° Flf = Flf ottm/g, 
since this is true on each orbit stratum. 

4.2. If M is a complete Riemannian G-manifold we may also consider the vector 
space j£(M)^Qj. of all smooth horizontal G-invariant vector fields, which are normal 
to each orbit which they meet. The space X{M)^^^ is a Lie algebra if and only if the 
vector subbundle Nor(M)|Mi-eg is integrable which is almost equivalent to the fact 
that M admits a section, since then the horizontal bundle over M^eg is integrable; 
there might be topological difliculties, namely, the leaves of the horizontal bundle 
might be not closed. 

4.3. Differential equations of second order on M/G. Let k : TTM TTM 

be the canonical involution. Recall that a vector field F on TM is called a differential 
equation of second order on M if koF = F or, equivalently, if T{t:m)°'^ — Wtm- It 
is called a spray if it is quadratic in the sense that r(m^.X) = mj^ .T{mf^).T{X), 
where is the scalar multiplication by t on TM. 

Let M be a proper G-manifold. Then the extension of the G-action to TM is 
also proper. The projection f of a G-invariant second order differential equation 
or spray F e X{TM)^ to X{TM/G) is called a second order differential equation 
or spray on M/G. By 4.1 we know that F is tangent to all strata of TM/G, thus 
integral curves of f make sense and are unique as integral curves of vector fields on 
manifolds. Clearly, the projection of an integral curve of F is an integral curve of 
f on TM/G. 

4.4. The geodesic spray on M/G. Fix a complete G-invariant Riemannian 
metric on M and denote by F its geodesic spray. The flow lines of F are the 
velocity flelds of geodesies on M. The corresponding spray f e X{TM/G) is called 
the geodesic spray on M/G. Its flow lines are complete and each is contained in 
one stratum of TM/ G. 

For a; e M let Nor(M)a; = {Tj;{G.x))-^ the normal space to the orbit, which 
we may split as orthogonal direct sum of the subspace Nor^°^(M)a; = Nor(M)^^ 
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which is invariant under the isotropy group G^, and its orthogonal complement 
in Nor(M)a;. We consider Nor(M) := (J^g^Nor(M)^ C TM, and similarly for 
Nor'"^(M). These are G-invariant subsets of TM which can be considered as 
families of sub vector spaces with jumping dimensions: Over singular strata the 
dimension may become larger. Note that Nor(M)a; = Nor''^^(M)a; if and only if x 
is a regular point. 

Nor(M) is invariant under the flow of the spray F since a geodesic which is 
orthogonal to one orbit is orthogonal to any orbit it meets. However, Nor'^^'"{M) 
is not invariant under the flow of the spray F, since a geodesic starting at a regular 
point orthogonally to the orbit may hit later a singular point where its tangent 
vector is still orthogonal to the orbit but no longer invariant under the (larger) 
isotropy group. Consequently, Nor(M)/G C TM/G is invariant under the flow of 
the spray F. We may consider Nor(M)/G as a substitute of the tangent bundle 
of the the orbit space M/G since the normal slices suffice to describe any tangent 
vector which moves an orbit infinitesimally. 

Definition. A geodesic on M/ G is a curve of the form 

t ^ (ttm/g o Flf ) (0, f e Nor(M)/G 

This definition fits well with concept of minimal geodesic arcs as treated in section 
3; geodesies are prolongations of minimal geodesic arcs. Clearly geodesies in M/G 
are exactly the projections onto M/G of normal geodesies in M. 

4.5. Example. Let G — > 0{V) be a polar representation of a compact group, 
with section T, G V, a linear subspace which meets every orbit orthogonally. Then 
V/G — T,/W{T,) is representated by a chamber C in S. The normal geodesies in V 
can be chosen to lie in E, thus the geodesies in V/G = E/VF(S) = C are straight 
lines in the interior of C which are reflected by the walls: the incoming angle equals 
the outgoing angle. 

4.6. Ballistic curves. The projection t i— > ttm/g ° Fl^(^) onto M/G of a flow 
line of the geodesic spray on TM/G with general initial vector ^ e TM/G (which 
need not be in Nor(M)/G), is called a ballistic curve. It depends on external data: 
ttm/g- TM/G — > M/G is bigger than the tangent bundle. 

4.7. The Jacobian fiow. We recall the following result: 

Theorem. [17] Let V : TM TTM be a spray on a manifold M. Then ktmoTT : 
TTM TTTM is a vector field. Consider a flow line 

Y{t) = Fl^^^^°^^(y(0)) 

of this field. Then we have: 

c :— TTM o tttm oY is a geodesic on M. 

c = tttm oY is the velocity field of c. 

J :— T{ttm) oY is a Jacobi field along c. 

J = Km oY is the velocity field of J. 

V = K o Km oY is the covariant derivative of J . 
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The Jacobi equation is given by: 

= Va, Va, J + R{J, c)c + Va, Tor( J, c) 
= KoTKoTToY. 

This implies that in a canonical chart induced from a chart on M the curve Y{t) 
is given by 

{c{t),c'{ty,j{t),j'{t)). 

On a complete Riemannian G-manifold M with geodesic spray T we may thus 
consider the the G-invariant vector field ktm o TV : TTM TTTM and the 
induced smooth derivation 



ktmoTF e XiTTM/G). 

We have 

T{7rTM/G)°I^TM ° TV = TtTtm ° I^TM ° TV = TTttM ° TV = r O TTtm = ^^T^TM/G- 

We consider a flow line 

Y{t) - Fl^^^^°^(y(0)) 

of this held which respects the orbit stratification. Then we have: 

(1) /; H- > c{t) := 'Km/g°'^tm/g °Y{t) G M/G is a geodesic on Ad/G if the initial 
velocity vector T^TM/GiYiO)) G Nor(M)/G is normal. If not then c{t) is a 
ballistic curve on M/G. 

(2) t 1-^ c{t) — txtm/g ° ^(^) £ TM/G is the velocity field of c. It respects the 
orbit stratification of TM/G since it is a flow line of f . 

(3) t ^ J{t) :— T{ttm)/g ° ^{t) £ TM/G can be called a Jacobi field along c. 
It does not respect the orbit stratification in general. 

(4) J — km/g o is the velocity field of J. It respects the orbit stratification. 

(5) Va^ J = K o Km/g o is the covariant derivative of J. 

5. Example: Hermitian and symmetric matrices 

5.1. Simplest Example. Let act on by rotations. Then M^/S"^ = [0, oo), 
and 7fi^ : TR'^/S^ R'^/S^ looks as follows: The fiber over is [0, oo) again, and 
the fiber over t > is R^. Normal geodesies on are lines through 0, so geodesies 
on IR^/S"^ are constant speed curves coming in from infinity on [0, cxo) which are 
reflected at and go out again at constant speed: t \tv\. However, ballistic 
curves seem to carry a charge and behave as being repelled by a held carried by 
the singular orbit 0, namely 



1 1— > ^y (xi + tvi)^ + {x2 + tv2)'^i where a;,v are linearly independent in M^. 
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5.2. Simple Example. Let SO (2) act on the space S{2) of symmetric (2 x 2)- 
matrices by conjugation, a polar representation, where the diagonal matrices form 
a section. A chamber is here given by the halfspace 

S{2)/SO{2) = C:=l^(^\' ^°):Ai>A2}. 

Let us describe TS{2)/SO{2) S{2)/SO{2) = C. Over a point A = diag(A, A) in 
the wall of C we can use the isotropy group SO{2)a — SO{2) to put the tangent 
vector in normal form, so the fiber there is the half space C. The fiber over an 
interior point is the whole vector space S{2). 

As in 4.5 geodesies in S{2)/ S0{2) = C are straight lines which are reflected by 
the wall {Ai = A2}. One can compute the ballistic curves. For 

\0 a2 J \V3 V2 J 

the curve of eigenvalues in C is 

^ 1 / ai + a2 + t{vi + V2) + y /jai - 02 + t{vi - V2W + \ 
^\X2{t)J 2\ai + a2 + t{vi + V2) - y/{ai - aa + t{vi - V2))'^ + ^t'^vj J ' 

Here 1 1— > 01+02+^(^1+^2) is the coiiipoiiciit 011 tlic wall Ai = A2 of C which travels 
with constant speed, whereas \/ (ai — 02 + t(f 1 — V2)'^ + At'^v^ is the distance from 
the wall. So again the ballistic curve is being repelled by a field carried by the wall. 
If it contains one regular orbit and is not a geodesic, then it never hits the wall. 

5.3. The space of Hermitian matrices. Let G = SU{n) act on the space H{n) 
of complex Hermitian (n x n)-matrices by conjugation, where the inner product 
is given by the (always real) trace Ti:{AB). This is a polar representation, where 
the diagonal matrices with real entries form a section E. A chamber is here given 
by the quadrant C C E consisting of all real diagonal matrices with eigenvalues 
Ai > A2 > ■ ■ ■ > \n- Geodesies in H{n)/SU{n) = C are straight lines which are 
refiected by all walls {A^ = Aj^ = • • • = Ai_|_fc}. 

A ballistic curve looks as follows: Let ^ be a diagonal matrix with eigenvalues 
fli > • • • > and let V = (vi^) be a Hermitian matrix. The ballistic curve is 
then X{t) = (Ai(t) > • • • > An(t)), the curve of eigenvalues of the Hermitian matrix 
A + tV. 

5.4. Hamiltonian description. Let us describe ballistic curves as trajectories of 
a Hamiltonian system on a reduced phase space. Let T'*H{n) = H{n) x H{n) be 
the cotangent bundle where we identified H{n) with its dual by the inner product, 
so the duality is given by {a, A) — Tr{Aa). Then the canonical 1-form is given 
by d{A,a,A',a') = Tr(Q;^'), the symplectic form is u;(^A,a){{A' , Oi'), {A" , a")) = 
Tr{A'a" — A"a'), and the Hamiltonian function for the straight lines {A + ta, a) on 
H{n) is h{A, a) = | Tr(a2). The action SU{n) 3 g h-^ {A gAg'^) lifts to the ac- 
tion SU (n) 3 g ^ ((A, a) 1— > {gAg~^^ gag~^)) on T*H{n) with fundamental vector 
fields C,x{A,a) = (A, a, [X, A], [X, a]) for X e 5u(n), and with generating func- 
tions fx{A,a) = d{Cx{A,a)) = Tr(Q;[X,^]) = Tr([^,a]X). Thus the momentum 
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mapping J : T*H{n) su{n)* is given by {X, J {A, a)) = fx {A, a) = Tr{[A, a]X). 
If we identify su(n) with its dual via the inner product Tr(XF), the momentum 
mapping is J{A, a) = [A, a]. Along the line t ^ A -\-ta the momentum mapping 
is constant: J {A + ta,a) = [A,a] = Y E 5u{n). Note that for X e su(n) the 
evaluation on X of J{A + to, a) e su(n)* equals the inner product: 

(X, J{A + ta, a)) = IV(^ {A + ta),Cx{A + ta)), 

which is obviously constant in t; compare with the general result of Riemannian 
transformation groups, e.g. [16], 8.1. 

According to principles of symplectic reduction [1], 4.3.5, [27], [12], [22], we have 
to consider for a regular value Y (and later for an arbitrary value) of the momentum 
mapping J the submanifold J~^{Y) C T*H{n). The nuU distribution oiuj\J-^{Y) 
is integrable (with jumping dimensions) and its leaves (according to the Stefan- 
Sussmann theory of integrable distributions) are exactly the orbits in J~^{Y) of 
the isotropy group SU{n)Y for the coadjoint action. So we have to consider the 
orbit space {Y) / SU {n)Y ■ If Y is not a regular value of J, the inverse image 
J~^{Y) is a subset which is described by polynomial equations since J is polynomial 
(in fact quadratic), so J~^{Y) is stratified into submanifolds; symplectic reduction 
works also for this case, see [27]. 

5.5. The case of momentum y = gives again geodesies. If y = 

then SU{n)Y = SU{n) and J~-^(0) = {{A,a) : [A,a] = 0}, so A and a com- 
mute. If A is regular (i.e. all eigenvalues are distinct), using a uniquely deter- 
mined transformation g G SU{n) we move the point A into the open chamber 
C" C H{n), so A = diag(ai > 02 > ■■■ > a„) and since a commutes with A 
so it is also in diagonal form. The symplectic form u restricts to the canonical 
symplectic form on C° x E = C° x E* = T*{C°). Thus symplectic reduction 
gives (J-^O) n {T*H{n))reg)/SU{n) = T*{C°) C T*H{n). By [27] we also use 
symplectic reduction for non-regular A and we get (see in particular [12], 3.4) 
J-^{0)/SU{n) = T*C, the stratified cotangent cone bundle of the chamber C con- 
sidered asstratified space. Namely, if one root £j(A) = — a^+i vanishes on the 
diagonal matrix A then the isotropy group SU (n)^ contains a subgroup SU (2) cor- 
responding to these coordinates. Any matrix a with [A, a] = contains an arbitrary 
hermitian submatrix corresponding to the coordinates i and i + 1, which may be 
brougth into diagonal form with the help of this SU (2) so that £i(ct) = ctj— ai+i > 0. 
Thus the tangent vector a with foot point in a wall is either tangent to the wall 
(if ai = ai+i) or points into the interior of the chamber C. The Hamiltonian h 
restricts to C" x S 9 (A^a) ^SiCtf? so the trajectories of the Hamiltonian 
system here are again straight lines which are refiected at the walls. 

5.6. The case of general momentum Y. If y 7^ G su{n) and if SU{n)Y 
is the isotropy group of Y for the adjoint representation, then it is well known 
(see references in 5.4) that we may pass from Y to the coadjoint orbit 0{Y) = 
M*{SU{n)){Y) and get 

(1) J-\Y)/SU{n)Y = J-\0{Y))/SU{n) = {J-\Y) x 0{-Y))/ SU{n), 
where all (stratified) diffeomorphisms are symplectic ones. 
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5.7. The Calogero Moser system. As the simplest case we assume that Y' e 
su{n) is not zero but has maximal isotropy group, see [10]: So we assume that Y' has 
complex rank 1 phis an imaginary multiple of the identity Y' — \/— l(cl^ + v (E)v*) 
for 7^ f = (v*) a column vector in C". The coadjoint orbit is then 0{Y') = 

{^/^{cln + W ® W*) : W e C^, \w\ = \v\}, isomorphic to ^^n-l/^l ^ £pn^ Qf 

real dimension 2n — 2. Consider {A', a') with J{A',a') = Y' , choose g e SU{n) 
such that A = gA'g~^ = diag(ai > a2 > • • • > a„), and let a = ga'g~^. Then 

the entry of the commutator is [A,Q;]jj = aij{ai — aj). So [A, a] — gY'g~^ =: 
Y = \/—l{cIn + gv ® (gv)*) = ^/—l{cln + w (E) w*) has zero diagonal entries, thus 
< w^w^ — —c and = exp{\/ —19i)^/^ for some 6i But then all off-diagonal 
entries Yij = ^/—Iw'^w^ = — \/^c exp(\/^(6'j — 6'^)) ^ 0, and A has to be regular. 
We may use the remaining gauge freedom in the isotropy group SU (n) ^ = S{U (!)"■) 
to put = cxp(\/^l^)\/— c where 6 = ^6i. Then Yij = — c^/— 1 for i ^ j. 

So the reduced space {T* H{n))Y is diffeomorphic to the submanifold of T*H{n) 
consisting of all (A, a) G H{n) x H(n) where A = diag(ai > a2 > ■ ■ ■ > a„), 
and where a has arbitrary diagonal entries ctj := an and off-diagonal entries 
aij — Yij/ [tti — aj) = —c\/—l/ (oj — CLj). We can thus use ai, . . . , a„, cci, . . . , as 
coordinates. The invariant symplectic form pulls back to a;^^ q,)((A'q;'), {A" , a")) = 
Tr(yl'Q;" — A"a') = ^{a'^a" — a"a'^). The invariant Hamiltonian h restricts to the 
Hamiltonian 



2 ^ (ai - ajY 

This is the famous Hamiltonian function of the Calogero-Moser completely inte- 
grable system, see [18], [19], [10], and [22], 3.1 and 3.3. The corresponding Hamil- 
tonian vector field and the differential equation for the ballistic curve are then 



dai ^ (fti - ftj)^ QoLi 



cii = 2 J] 



Note that the ballistic curve avoids the walls of the Weyl chamber C . 

5.8. Degenerate cases of non-zero momenta of minimal rank. Let us 

discuss now the case of non-regular diagonal A. Namely, if one root, say £12 (A) = 
a\ — ai vanishes on the diagonal matrix A then the isotropy group SU {n)A contains 
a subgroup SU (2) corresponding to these coordinates. Consider a with [A, ct] — F ; 
then = OLYiiax — 02) = Y\i. Thus a. contains an arbitrary hermitian submatrix 
corresponding to the first two coordinates, which may be brougth into diagonal 
form with the help of this SU{2) C SU{n)A so that £12(0;) = ai — 02 > 0. Thus 
the tangent vector a with foot point A in a wall is either tangent to the wall (if 
ai = 02) or points into the interior of the chamber C (if cti > 02) • Note that then 
Yii = Y22 = Y12 = 0. 
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Let US now assume that the momentum Y is of the form Y = ■\/^{cIn-2+v<Siv*) 
for some vector ^ v E C"~^. We can repeat the analysis of 5.7 in the subspace 
C"~^, and get for the Hamitonian 



^ n ^ 



— dtti ^ (ai — ai)^dai^ 

(,2 

di = 0,2 = 0, di = 2 } -:r for i > 2. 

So the baUistic curves are just the trajectories of the Cafogero-Moser integrable 
system inside the wall {01 — 02 = 0} complemented by a geodesic in the coordinates 
orthogonal to this wall. Of course we may add other vanishing roots. 

5.9. The case of general momentum Y and regular A. Starting again with 
some regular A' consider [A', a') with J(A',a') = Y', choose g G SU{n) such that 
A = gA'g~^ — diag(ai > 02 > • • • > a^), and let a = ga'g~^ and Y = gY'g~^ = 
[A, a]. Then the entry of the commutator is Yij — [A, a]ij = aij{ai — Oj) thus Ya = 
0. We may pass to the coordinates Oi and ctj := an for 1 < z < n on the one hand, 
corresponding to J~^{Y) in 5.6.1, and Yij for i ^ j on the other hand, corresponding 
to 0{^Y) in 5.6.1, with the linear relation Yji = —Yij and with n — 1 non-zero 
entries Yij > with i > j (chosen in lexicographic order) by applying the remaining 
isotropy group SU{n)A = S{U{1)'') = {diag(e^^i, . . . , e^^") : E^i ^ 27rZ}. 
We may use this canonical form as section 

{J-\Y) X 0{-Y))/SU{n) J~\Y) x 0{-Y) c TH{n) x su{n) 

to pull back the symplectic or Poisson structures and the Hamiltonian function 

MA a) = 1 li(a^) = i ^ a? - 1 5: ^-^i^, 



2 ^ • 2^ (a,- ajf 
dh = Y,a, da, + Y -r^^^^do, - doj) ^ ^'''"^^'^ 



(1) = Valdai + 2 V- — ^\-^ doi-Y,-f ^-^^^Yij. 

i i^j ^ * i^j ^ ^ 

The invariant symplectic form on TH{n) pulls back to (jj(^A,a.){{^' = 
Tr(A'Q;" — A" a') = YliWi^'l ~ ^'l^'i) ^^us to Ylfi dc^i A dai. The Poisson structure 
on su{n) is given by 

Ay{U, V) = Tt{Y[U, V]) = Yl (XmnUnpVpm ' YmnVupU^m) 

m,n,p 
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Ay= J2 ^Y{dYij,dYki)dY,j®dY^, 

= ^ 'Y{YmnSni3jkSlm-YmnSnkSliSjm)dYij'^dYki 
i^j,k^l m,n 

= XI O^ii^jk - YjkSu)dYi^ dy^^ 

Since this Poisson 2- vector field is tangent to the orbit 0{—Y) and is SU{n)- 
invariant, we can push it down to the orbit space. There it maps dYij to (remember 
that Yii = 0) 

k^l k 

So by (1) the Hamiltonian vector field is 

The differential equation thus becomes (remember that Yjj — 0): 

Oj — oil 

. (^-3^ = 2 2.(^-3^ 



YjiYjf^ Yj^jY/^j 



Consider the Matrix Z with Za = and Zij = Yij/{ai — aj)'^. Then the differential 
equations become: 



This is the Calogero-Moser integrable system with spin, see [3] and [4] . 

5.10. The case of general momentum Y and singular A. Let us consider 
the situation of 5.9, when A is not regular. Let us assume again that one root, say 
£12 (A) = ai — a2 vanishes on the diagonal matrix A. Consider a with [A, a] = Y. 
From Yij = [A,a]ij = oiij{ai — aj) we conclude that Yu = for all i and also 
Y12 — 0. The isotropy group SU{n)A contains a subgroup SU(2) corresponding to 
the first two coordinates and we may use this to move a into the form that ai2 = 
and £12(0:) > 0. Thus the tangent vector a with foot point A in the wall {ei2 = 0} 
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is either tangent to the wall when ai = a2 or points into the interior of the chamber 
C when CKi > a2- We can then use the same analysis as in 5.9 where we use now 
that Yi2 = 0. 

In the general case, when some roots vanish, we get for the Hamiltonian function, 
vector field, and differential equation: 



\Y--\ 



2^* 2 ^ (ai-a,)2' 



where we use the same notation as above. It would be very interesting to investigate 
the reflection behavior of this ballistic curve at the walls. 

5.11. Example: symmetric matrices. We finally treat the action of SO{n) = 
SO{n,M) on the space S{n) of symmetric matrices by conjugation. Following the 

method of 5.9 and 5.10 wc get the following result. Let t ^ A' + ta' be a straight 
line in S{n). Then the ordered set of eigenvalues ai{t), . . . , an{t) of A' + ta' is part 
of the integral curve of the following vector field: 

ai^aj,k ■" i,aj^ah ■' 



where we also note that Yij = Zij = whenever Oi = aj. 

5.12. Remark. Along the same line one can investigate the action of the quater- 
nionic unitary group Sp{n) on the space of all quaternionic hermitian matrices. 
Since the results are more complicated to write down and since they are a special 
case of section 6 we do not dwell on them here. 



6. Ballistic curves on polar representations 

6.1. The setting. Let p : G 0{V, ( , )) be a polar representation of a 
compact connected semisimple group, see 4.5, with section T, C V, a, linear subspace 
which meets every orbit orthogonally. Then V/G = T,/W{T,) is representated by 
a chamber C in S. The normal geodesies in V can be chosen to lie in S, thus the 
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geodesies in VjG = E/VF(S) = C are straight lines in the interior of C which are 
reflected by the waUs. 

By Dadok, [8], proposition 6, which follows from his classification, for any polar 
representation there exists an isotropy representation of a symmetric space with the 
same orbits, and it suffices to investigate those latter ones. Thus we can assume 
that [ = ® F is a reductive decomposition of a compact semisimple Lie algebra [, 
where £| is the compact Lie algebra of G, and where ( , ) is an invariant positive 
definite inner product on I, the negative of the Killing form, and where I = g © F is 
an orthogonal decomposition. Moreover the infinitesimal action p' of g on V is by 
the adjoint action, p'{X)A — [X, A], so [0, V] C and [V, V] C q. As section E we 
may use any maximal abelian subspace in V. Moreover we shall use the following 
lemma. 

6.2. Lemma. In the situation above we have: 

(1) For A & V let g' be the orthogonal complement of the centralizer Zq{A) in 
Q and let V' be the orthogonal complement to the centralizer Zv{A) in V 
such that I = Zg{A) © g' © Zv{A) © V . 

Then ad^ induces linear isomorphisms ad^ : V' —>■ [A, V'] = q' and 
adA-.g' ^[A,q']^V'. 

(2) An element A & V is regular for the G-action on V if and only if the 
centralizer Zv{A) in V is a maximal commutative subalgebra ofV. In this 
case Zv{A) is the unique section in V containing A. 

(3) An element A E V is regular for the G-action if and only if there exists 
an element X E Q such that X + A is regular in I, so that Zi{X + A) is a 
Cartan subalgebra of I. 

(4) A linear subspace T, G V is a section if and only if there exists a Cartan 
subalgebra i) of q such that f) © E 2s a Cartan subalgebra of i. 

In this case, let R C i^(E, M) be the system of restricted roots so that we 
have the orthogonal root space decomposition 

1={)®E®01a 

xeR 

where each Ix has an orthogonal basis E\, B\, where i = 1, . . . ,kx, and 
where E\ e Q and B\ e V are unit vectors, such that [A, E\] = X{A)B\ 
and [A, B{] = XiA)E{ for allAeT.. 

(5) Let Tj dV be a section for the G-action on V and let A & "E. Then for any 
a G V with [A, a] — there exists then there exists some g G Ga — Zq[A) 
with g.a e E. 

Proof. (1) The result follows from the Fitting decomposition [ = Z[{A) + ad^(l) of 
the skew-symmetric endomorphism ad^ : — 5 which we may write as 

[ = iZ^(A) © adA(F')) © (ZviA) © ad^(0')) 

since ad a interchanges and V. 

(2) It is known (see e.g. [8]) that the G-regular elements in a polar G-module V 
are exactly those A eV such that Zg{A) is of minimal dimension. Moreover, any 
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A &V is contained in some section E, and any section E is a maximal commutative 
subspace ofVcl = Q®V. Since a section E generates a compact torus in the 
Lie group L, there exists an element A G E such that Zv{A) = E. These elements 
are characterized as those such that Zv{A) is of minimal dimension, since for any 
A & V the centralizer Za{V) contains a section E. By (1) the element A E V is 
G-regular if and only if dim.{Zv{A)) is minimal, i.e. Zv{A) = E is a section. 

(3) follows from (2). 

(4) The first assertion follows from (3), and the rest is well known in the theory 
of symmetric spaces. 

(5) Denote by E' a maximal commutative subspace of V containing A and a. 
Then E' is a section. Now the isotropy group Ga — Zg{A) acts transitively on the 
set of all sections of V which contain A. So in particular there exists g e Ga such 
that g.T,' = E, and hence g.a e E. □ 

6.3. Hamiltonian description and symplectic reduction. Generalizing 5.4, 
under the assumption of 6.1, we consider TV — VxV^VxV* = T*V where we 
identify V with V* via the inner product. The canonical 1-form is then given 

by 0{A,a,A',a') = {a, A'), the symplectic form is a'), (A", a")) = 

{A', a") — {A" a'), the Hamiltonian function for the straight lines {A + ta,a) is 
h{A, a) — I (a, a). The action of G on y lifts to the diagonal action on TV = V xV 
with fundamental vector field Cx{A, a) — (A, a, [X, A], [X, o;]) for X e g and with 
generating function fxiA,a) = 9{Cx{A,a)) = {a,[X,A]) = {X,[A,a]), where 
we used the invariance of the inner product on 1. Thus the momentum map- 
ping J : TV g* = Q for this action is given by (X, J(A, a)) = a), so 
J{A, a) = [A, a]. Along each line the momentum is constant, J{A + ta, a) = [A, a]. 

According to principles of symplectic reduction [1], 4.3.5, [27], [12], [22], we have 
to consider a regular value Y E g (and later for an arbitrary value) of the momentum 
mapping J and the submanifold J~^{Y) C TV. The null distribution of uj\J~^{Y) 
is integrable (with jumping dimensions) and its leaves (according to the Stefan- 
Sussmann theory of integrable distributions) are exactly the orbits in J~^{Y) of 
the isotropy group Gy for the coadjoint action. So we have to consider the orbit 
space J~^{Y)/Gy- If Y is not a regular value of J, the inverse image J~^{Y) is 
a subset which is described by polynomial equations since J is polynomial (in fact 
quadratic), so J~^{Y) is stratified into submanifolds; symplectic reduction works 
also for this case, see [27]. 

6.4. The case of momentum Y — gives again geodesies. If y = then 

Gy = G and J~^(0) = {{A, a) : [A^a] = 0}, so A and a commute. Wc may use 
g E G to move {A, a) such that A E C G T, G V . IfAGEis regular for the 
G-action then by lemma 6.2.2 it is also regular in the sense that E = Zv{A), thus 
a e E also, and the reduced phase space is TC° = C° x E. The Hamiltonian is 
still h{A, a) — ^(a, a), the line A + ta is in E, and thus projects to a geodesic in 
C which is reflected at walls. 

If A is not regular and [A, a'] = then there exists g in the isotropy group Ga 
such that a — g.a' e C, by 6.2.5. If A is in a wall {A = 0}, and if X{a) — 0, then 
the geodesic is in the same wall. If X{a) > then the geodesic is reflected at this 
wall. 
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6.5. Symplectic reduction at regular points. If Y ^ e g and if Gy is the 

isotropy group of Y for the adjoint representation, then it is well known that we 
may pass from Y to the adjoint orbit 0{Y) = Ad* {G){Y) and get 

(1) J-\Y)/Gy = J-\0{Y))/G = {J-\Y) X 0{-Y))/G, 

where all (stratified) diff'eomorphisms are symplectic ones. 

We start again with some regular A & V which we may move into C° C S C 
V by using some suitable g E G. Given a E V we consider [A, a] = Y E g. 
According to the restricted root space decomposition 6.2 we can decompose a = 
Oi-E + ^xeR i ^x-^x where aj: e E. Similarly we decompose Y = Yi, + J2x(=R i ^a-^a- 
Then Y = [A, a] implies Y"^ = e and Y^ = X{A)a\. Since A is regular, A e C° 
and thus X{A) ^ for all A G -R. Let us use also an orthonormal basis 5^ of S to 

expand as = Xli ciq-^o A = Y,i ^o-^o- 
We can thus use as coordinates 

A^a}) e C° xE = TC° 
Y^ = X{A)a\ e Ad{G).Y 

The Hamiltonian function in these splitting is given by 
h{A,a) = l{a,a) = lj2(<)"+l E ^ 

i XeR,i ^ ' 

i X€R,i ^ ^ k X€R,i ^ ' 

The Poisson 2-field on g (which is tangent to each adjoint orbit) is given by 

AvidU, dV) = (y, [U, V]), Y,U,Veg 

Ay= Yl ^Y{dYldY^)dy.®dy^ 



= E (^'E«.)^>-«®^- 

X,ij.,i,j k 



'y3 



IJ;3 k 



where we used the convention [E^, EJ^] = N^x^ E^.^.^. We get the following 
Hamiltonian vector field 



X€R,i,k ^ ' X€R,i ^ ' 
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and the differential equation 

= - E T^(y.E<'«'+.> = - E i^'^'K-^jD- 

A6i?,i ^ ' k XeR,i ^ ' 

Let us now write Y = '^\^fiiY\-E\ =: YlxeR^^ where Y\ E 0, and Z = 
^Aefl \{AY ^ 0' Then the differential equation becomes: 

so that finally we have 

(2) (A, ) = E)pp^ ^ = 

So the ballistic curve in C avoids the walls whenever Yx{t) ^ for all restricted 
roots A G i?, and just one time t. 

6.6. Symplectic reduction at singular points. Let us now consider a singular 
A E V which we may move into C C E C ^ by using some suitable g E G. Then A is 
contained in some intersection of walls of C so n{A) = for fx E Rq C R. Given a G 
V we consider [A, a] = Y E g. Using the decompositions a = + J2xeR i 

and Y = ^ij+X^Aefl i ^a--^a ~- ^fi+X^Aei? ^-'^ ^-^ ^^^^ ^ ~ "^i iniplies 

Ff, = G [) and y/= A(A)a\ for aU X e R. Thus we get = for aU G i^o- 
So we can follow the analysis in 6.5 without change if we agree = means also 
(Y^)'^ / fx{A) = and = Y^/fj,{A)'^ = 0. So again the ballistic curve is described 
by the equations (6.5.2). The second equation Y = [Y, Z] shows that Y^ = along 
the the whole ballistic curve for ^ G -Rq- So the ballistic curve is composed of one 
just like in (6.5.2) inside the intersection of walls {B G C : fJ.{B) = for all fi G Rq} 
together with a geodesic (reflected at walls) transversal to this intersection of walls. 
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